Affective Video Data Collection Using an Automobile Simulator

The correlation between driver status and safety has increased interest in automated systems that can infer the physical and mental state of drivers [2, 3]. So far, most research on automated recognition of driver state has focused on physical state. More recently, researchers have proposed inferring the mental states of drivers by extracting drivers’ facial expressions from video data. Although systems that infer physical state have been evaluated in simulators or in real driving conditions, this has not been the case for systems inferring mental states which rely primarily on video data. Consequently, issues regarding the design of an experimental setup to collect such affective data have not been explored. Here, we describe our experimental setup for collecting video data from drivers.